Keyword Research Blogs

Spiders like Googlebot choke on Session IDs

June 25th, 2004

by Stephan Spencer

Many ecommerce sites have session IDs or user IDs in the URL of their pages. This tends to cause either the pages to not get indexed by search engines like Google, or to cause the pages to get included many times over and over, clogging up the index with duplicates (this phenonemon is called a “spider trap”). Furthermore, having all these duplicates in the index causes the site’s importance score, known as PageRank, to be spread out across all these duplicates (this phenonemon is called “PageRank dilution”).

Ironically, Googlebot regularly gets caught in a spider trap while spidering one of its own sites - the Google Store (where they sell branded caps, shirts, umbrellas, etc.). The URLs of the store are not very search engine friendly: they and are overly complex, and include session IDs. This has resulted in 3,440 duplicate copies of the Accessories page and 3,420 copies of the Office page, for example.

If you have a dynamic, database-driven website and you want to avoid your own site becoming a spider trap, you’ll need to keep your URLs simple. Try to avoid having any ?, &, or = characters in the URLs. And try to keep the number of “parameters” to a minimum. With URLs and search engine friendliness, less is more.

Spread the word: delicious this:Spiders like Googlebot choke on Session IDs digg this:Spiders like Googlebot choke on Session IDs spurl this:Spiders like Googlebot choke on Session IDs furl this:Spiders like Googlebot choke on Session IDs reddit this:Spiders like Googlebot choke on Session IDs Add to Y!:Spiders like Googlebot choke on Session IDs

Pages (10): « First ... « 7 8 9 [10]


Related tags

and/or
and/or

Newsletter

Web marketing virtuoso Stephan Spencer, shares a wealth of emarketing experience and hard-hitting, practical advice in our monthly newsletter. It's full of valuable insights...You should subscribe.








Latest posts
Latest comments


Contact Us

HEADQUARTERS
2820 Walton Commons West, Suite 123
Madison, WI 53718 USA
Phone: (608) 285-6600
Toll-free: 888 207-1109

REGIONAL OFFICE
36 Anzac Rd., Browns Bay
Auckland, New Zealand
Phone: (+64) 9 476-4601
infodesk@netconcepts.com